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I  j  The  over-all  goal  of  the  present  program,  conducted  by  Applied  Psycho- 

logical  Services,  is  to  develop  a  technique  for  evaluating  the  information  trans- 
‘  ^  fer  characteristics  of  the  displays  in  a  display*^  human  operator-^  control  system, 

j  The  basis  of  the  study  is  the  present  state  of  the  art  of  Signal  Corps'  systems. 

The  total  program  is  composed  of  eight  phases.  These  include: 
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Phase  1  Survey  and  development  of  a  technique  for  evalu¬ 
ating  display^  human  operator-^  control  systems 
and  mathematical  expression  of  the  logic 

Phase  2  Development  of  exponents  for  the  mathematical 
expression  of  the  logic 

Phase  3  First  verification  of  technique  against  outside 
criterion  data 

Phase  4  Application  of  the  technique  to  additional  repre¬ 
sentative  Signal  Corps'  equipments  and  systems 

Phase  5  Determination  of  the  uniqueness  of  the  factors 

included  in  the  mathematical  expression  and  ap¬ 
propriate  modification  of  the  technique 

Phase  6  Study  of  additional  factors  which  might  enhance 
the  validity,  reliability,  and  utility  of  the  tech¬ 
nique 

Phase  7  Preparation  of  a  user's  guide  for  the  technique 

Phase  8  Study  of  novel  human  information  handling  rates 
and  other  human  factors  engineering  problems 
associated  with  Signal  Corps'  equipment  and 
systems  under  research  and  development  for  the 
purpose  of  enhancing  the  utility  of  the  displays 
and  improving  system  effectiveness. 

The  present  report  represents  the  results  of  Phase  7. 
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ABSTRACT 

A  manual  containing  step-by-step  instructions  for  applying  the  Display 
Evaluative  Index  (DEI)  technique,  a  technique  for  measuring  the  ability  of  a 
display^ human  opera tor-^  control  system  to  transfer  information  and  for  the 
operator  to  act  on  this  information,  is  presented.  In  addition  to  these  instruc¬ 
tions,  the  manual  contains  computational  examples,  definitions,  a  glossary, 
and  suggested  work  forms. 
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I.  INTRODUCTION 


With  the  advent  of  more  complex  Signal  Corps'  systems  and  the  in¬ 
creased  time  span  between  system  concept  development  and  actual  hardware 
production,  the  need  has  arisen  for  methods  and  techniques  for  comparatively 
evaluating  various  design  concepts  before  prototype  systems  and  subsystems 
are  actually  produced.  While  subjective  standards  and  appraisals  possess 
merit  in  the  absence  of  more  objective  and  reliable  measurement  and  evalu¬ 
ative  techniques,  the  provision  of  quantitative  system  effectiveness  measure¬ 
ment  techniques  which  can  be  applied  early  in  the  design  stage  might  do  much 
to  eliminate  costly  design  errors  and  expensive  retrofits. 

Accordingly,  Applied  Psychological  Services  under  contract  with  En¬ 
gineering  Science  Department,  U.  S.  Army  Electronics  Research  and  Develop 
ment  Laboratory,  has  been  engaged  in  a  research  program  for  evaluating  the 
ability  of  the  displays  in  a  system  to  transfer  information  to  the  operator  in 
the  system  and  for  the  operator  to  act  on  the  information  received.  Specifi¬ 
cally,  it  is  the  purpose  of  this  technique  to  allow  comparative  answers  to 
questions  such  as; 

[1]  Can  it  be  expected  that  the  operator  will  receive, 
interpret,  and  act  on  the  information  presented  by 
design  A  in  a  superior  manner  than  to  design  B? 

[2]  If  we  change  a  display,  what  will  be  the  relative 
effect  on  the  equipment's  ability  to  transfer  infor¬ 
mation  to  the  operator  and  on  the  operator's  effec¬ 
tiveness? 
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This  technique  is  referred  to  henceforth  as  the  display  evaluative  tech¬ 
nique.  The  index  number  which  emerges  from  application  of  the  technique  is 
the  display  evaluative  index  or  DEI. 

Purpose  of  This  Manual 

This  manual  describes  the  method  for  applying  the  DEI  technique. 

Purpose  and  Scope  of  the  DEI  Technique 

The  purpose  of  the  DEI  technique  is  to  provide  a  quantitative  measure 
of  the  effectiveness  of  a  particular  equipment  design  from  the  information 
transfer  (display-^  operator  decision-^  control  action)  points  of  view.  The 
basis  of  the  equipment  evaluation  is  one  or  more  tasks  performed  by  an 
equipment -operator  combination.  A  task  is  essentially  defined  as  a  unit  of 
activity  rather  than  by  the  detailed  operations  which  the  operator  performs. 
Different  design  variations  may  require  the  operator  to  perform  different 
operations  in  order  to  perform  the  same  task.  For  each  application  of  the 
technique,  the  details  of  the  operations  must  be  known  for  each  design  varia¬ 
tion.  The  same  set  of  variations  may  give  different  rankings  over  different 
tasks. 

The  index  is  limited  to  one  operator  equipments  or  to  situations  in 
which  there  is  no  interaction  between  operators.  It  is  further  assumed  that 
the  indicators  and  controls  on  the  equipment  meet  minimal  human  factors 
design  standards  as  set  forth  in  various  human  factors  engineering  design 
guides.  Thus,  it  is  assumed  that  panel  arrangements  are  reasonable,  in¬ 
dicators  are  of  approved  types  and  sizes,  force  and  torque  requirements 


are  met,  directional  expectancies  are  satisfied,  etc.  The  DEI  does  not  rate 
the  electronic  or  mechanical  reliability  of  the  equipment.  It  does  rate  the  in¬ 
formation  transfer  effectiveness. 

Although  the  DEI  was  designed  to  possess  a  range  of  values  between 
0  and  1  (1  being  a  perfect  system),  any  individual  DEI  value  possesses  little 
interpretive  significance.  Comparison  of  any  individual  DEI  value  with  the 
DEI  values  of  alternative  designs  for  the  same  system  allows  a  choice  of  the 
best  system  from  the  points  of  view  considered. 
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II.  USE  AND  APPLICATION  OF  THE  DEI  TECHNIQUE 


The  first  step  of  the  analysis  involves  construction  of  a  transfer  chart 
for  the  particular  operator -equipment  task  being  considered. 

Transfer  Chart  Symbols 

The  transfer  chart  portrays  the  display  and  control  elements,  as  well 
as  the  information  transfer,  of  the  equipment-operator  combination  being  anal¬ 
yzed.  The  symbols  used  in  the  transfer  chart  are  shown  in  Table  1. 

To  construct  a  transfer  chart: 

1.  On  the  left  side  of  a  large  paper,  draw  a  symbol  (Table  1)  to  repre¬ 

sent  each  indicator  on  the  equipment.  Label  the  symbols  successively 
^1'  ^2'  with  the  actual  legends  appearing  on  the  equipment, 

or  by  its  function.  The  symbols  are  drawn  under  each  other. 

2.  On  the  right  side  of  the  chart,  draw  a  symbol  to  represent  each  con¬ 
trol  on  the  equipment.  Label  the  symbols  successively  C-,  C„,  etc.  , 
and  with  their  actual  legends  on  the  equipment  or  by  their  function. 
Your  transfer  chart  will  now  appear  like  that  shown  in  Figure  1. 


SECONDS 

timer 

o 

A 

RESET 

POWER 

^2 

A  <=2 

INTENSITY 

crt 

S  1 

Ci  C3 

FOCUS 

Figure  1  Preliminary  step  in  transfer  chart  construction 
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Table  1 


Suggested  Symbols  for  Transfer  Chart 


Indicator 


®  <) 


cr\ 


Control 


Mixer 


E> 


Gate 


1> 


Computation,  delay,  memory,  etc. 


I  label  for  display  element 


C  label  for  control  element 


(Dn)  label  for  element  composed  of  a  number,  n,  of  separate  ON-OFF 
indicators  or  controls 
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Links 

3.  Link  the  indicators  and  their  related  controls.  To  accomplish  this 
draw  a  solid  line  (called  an  information  link)  from  an  indicator  to  a 
control  if  the  control  is  actuated  at  any  one  time  on  the  basis  of  in¬ 
formation  obtained  solely  and  directly  from  its  related  indicator.  If 
this  operation  is  repeated,  no  additional  (duplicate)  link  is  drawn.  If, 
at  another  time,  the  same  control  is  actuated  on  the  basis  of  a  display 
on  another  indicator,  draw  a  separate  line  linking  these.  On  the  other 
hand,  if  a  control  action  depends  on  the  reading  of  several  indicators, 
use  one  of  the  following  schemes: 


(a)  If  the  control  can  be  actuated  on  the  basis  of  information 
from  any  one  of  several  indicators,  use  a  mixer,  to 
connect  the  indicators  to  the  control.  Figure  2  shows 
this  representation. 


(b)  If  the  control  action  requires  information  from  more 
than  one  indicator,  use  a  gate,  ,  to  connect  the  indi¬ 
cators  to  the  control. 
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Figure  3  Gate  representation 


(c)  If  the  information  from  one  or  more  indicators  must  be 
converted  or  otherwise  mentally  processed  by  the  opera¬ 
tor  before  he  operates  the  control  or  controls,  the  link 
is  broken  and  a  box,  |  |  ,  is  inserted.  Write  the  name 

or  formula  of  the  process  involved  in  the  box.  Each  line 
segment  is  considered  an  information  link. 


Figure  4  Mental  information  processing  representation 
The  direction  of  information  flow  is  indicated  by  arrows. 


4,  It  is  possible  that  one  control's  setting  may  be  used  as  the  basis  for 
adjusting  another  control.  This  situation  is  illustrated  in  Figure  5, 
where  the  setting  of  determines  the  setting  of  C^. 


Figure  5  Control-control  link 
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5. 


If  an  indicator  (e.  g.  ,  cathode  ray  tube)  or  control  is  to  be  marked 
according  to  its  own  display  (e,  g.  ,  target  position),  draw  an  informa¬ 
tion  link  from  the  indicator  or  control  back  to  itself 


6.  Draw  a  solid  line,  called  instruction  link,  to  a  control,  a  , 
or  a  [>  if  action  is  to  be  taken  on  the  basis  of  fixed  instructions 
(without  recourse  to  an  indicator).  An  instruction  link  is  not  an 
information  link  and  starts  in  the  space  between  indicators  and 
controls,  e.g.  ,  links  1  and  2  in  Figure  7. 

^  O 

*2  O - ■  ^  <=2 

Figure  7  Instruction  link 

Links  from  a  Q]]  or  [>  are  information  links. 
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7. 


If,  after  drawing  all  links,  one  or  more  "unused"  indicators  are 
apparent  and  these  indicators  merely  reflect  the  status,  condition, 
or  position  of  a  control  or  of  several  controls,  then  draw  a  dashed 
line,  called  a  corroborative  link,  from  the  control  or  controls  ^ 
the  indicator. 


li  ’i  & . A  ''i 

li  '2  O  ft 


Figure  8  Corroborative  link 

8,  Number  each  link,  starting  with  the  information  links  and  ending  with 
the  corroborative  links. 

9.  Label  each  box  successively;  i.  e. ,  B^,  etc. 

10.  If  an  indicator  or  control  is  composed  of  two  or  more  components  such 
as  lights  or  pushbuttons,  all  of  which  relate  to  a  common  function,  note 
this  by  writing  the  symbol  (Dn)  near  the  symbol  of  the  indicator  or  con¬ 
trol.  Here,  n  is  the  number  of  parts  (either  all  lights,  or  all  pushbut¬ 
tons,  etc.  ).  For  5  parts,  the  symbol  would  be  (D5),  as  shown  in  Figure  9. 


(D5) 

(D2) 

HEIGHT  I^  Q - 

- ^  C^  POWER 

DISTANCE  Q 

RUDDER 

Figure  9  Multiple  unit  representation 
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The  transfer  chart  is  now  complete.  This  chart  is  then  used  to 
obtain  the  values  for  the  different  variables  which  are  required  to 
compute  the  index  value.  To  make  this  part  of  this  work  easier,  a 
Transfer  Table  is  used. 


Transfer  Table 

The  procedure  for  constructing  the  transfer  table  is  now  given. 


11.  Construct  or  use  a  preprinted  form  of  the  transfer  table  shown  in 
Figure  10. 


1  2  3  4  5  6 


Link  No. 

Display 

Digits 

i 

Action 

Dibits 

Absolute 

Mismatch 

Dibits 

Link 

Weight 

Time 

t 

Figure  10  Form  for  transfer  table 


12.  In  the  column  headed  Link  No.  ,  list  all  links  and  box  numbers  on  the 
transfer  chart. 
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Display  Digits 

13.  In  the  column  headed  Display  Digits,  list  the  number  of  digits  of  in¬ 


formation  available  at  the  beginning  of  each  information  link, 
are  several  possible  cases: 


(a)  For  a  link  from  an  indicator  or  a  control,  the  number 
of  digits,  i,  if  not  apparent  from  the  element,  may  be 
calculated  by  using  the  formula: 


i 


For  a  meter  or  dial,  s  is  the  larger  of  the  following: 
(1)  the  total  number  of  different  possible  readings  the 
operator  can  make  (or  is  instructed  to  discern),  or  (2) 
the  actual  number  of  markings  on  the  dial.  For  a 
counter  type  indicator  and  for  a  combination  of  lights, 
s  is  the  actual  number  of  states  which  may  occur. 


Example  1  A  counter  type  indicator  has  three 
drums  and  all  settings  from  000  to  999  may  oc¬ 
cur.  It  can  be  seen  at  once  that  there  are  3  digits. 
Since  1000  possible  states  or  indicators  are  in¬ 
volved,  using  the  formula  gives  the  same  result: 


i  =  log 1000  =  3  digits 


Example  2  A  counter  never  can  indicate  200 
of  its  possible  1000  settings.  Therefore: 


i  =  logj^pSOO  =  2. 90  digits 
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There 


Example  3  A  meter  with  a  range  of  0  to  50  has 
scale  markings  every  five  units  and  is  read  to  the 
nearest  5  units.  There  are  thus  11  possible  states 
or  readings  (including  0).  The  number  of  digits 
must  now  be  calculated; 


i  =  log^pll  =  1.04  digits 


Example  4  A  meter  with  a  range  of  0  to  50  has 
scale  markings  every  five  units  and  is  read  to  the 
nearest  unit.  There  are  thus  51  possible  readings: 


i  =  log^Q51  =  1.71  digits 


Example  5  A  meter  has  a  range  of  0  to  50,  scale 
markings  every  five  units,  and  action  is  to  be  taken 
on  the  basis  of  only  three  regions  on  the  meter:  0  to 
15,  15  to  30,  and  30  to  50.  Here  s  is  11,  the  larger 
of  the  two  possibilities; 


i  =  logj^pll  =  1,04  digits 


Example  6  An  indicator  consists  of  three  lights. 
These  lights  are  used  in  combination  to  provide 
eight  different  signals,  s  is  8; 


(b)  The  number  of  digits  for  a  link  coming  from  a  mixer,  , 
is  equal  to  largest  value  of  i  ^  the  mixer. 

(c)  The  number  of  digits  for  a  link  coming  from  a  gate,  , 
equals  the  sum  of  the  input  information  to  the  gate,  where 
an  inhibiting  or  enabling  link  is  assigned  zero  information. 
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(d)  The  output  information  from  a  COMPARE  box  has 
either  log^gS  or  log]^Q2  digits  depending  on  whether 
the  comparison  is  of  type  <,  =,  >,  or  =,  jt. 

(e)  A  link  from  a  DELAY  box  has  the  same  information 
as  the  link  ^  the  box. 

<f)  A  link  from  a  COMPUTATION  box  has  information: 


i  =  logjjjv 

where  v  is  the  number  of  different  possible  values  of 
the  result  of  the  computation 

(g)  The  information  from  a  TABLE  REFERENCE  box  is: 

i  =  log^QV 

where  v  is  the  number  of  different  values  in  the  body 
of  tables,  i.  e.  ,  of  the  dependent  variable. 

Action  Digits 

14.  Under  Action  Digits,  for  each  link  list  the  number  of  digits  of  informa¬ 
tion  required  at  the  end  (arrow)  of  each  information  link.  Use  the  same 
formula  as  for  display  digits: 

i  ■  logics 

In  this  case  s  is  the  actual  number  of  positions  possible  for  the  control 
or  the  actual  number  of  index  marks  associated  with  a  control,  which¬ 
ever  is  greater.  Uncalibrated  or  continuous  knobs  (no  reference  marks 
or  detents)  are  considered  to  have  three  states  associated  with  them:  no 
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motion,  turn  clockwise,  and  turn  counterclockwise.  Therefore,  for 


these  controls: 


i  =  =  .477  digits 

Information  Match 

15.  Calculate  the  absolute  match  in  digits  between  each  link  and  its  related 
control.  Absolute  match  in  digits  applies  only  to  controls  associated 
with  information  links  or  transfers,  and  not  to  instruction  or  corrobora¬ 
tive  links.  It  is  the  absolute  difference  between  the  number  of  digits 
associated  with  a  link  and  the  number  of  digits  in  the  receiving  element, 
i.  e.  ,  the  smaller  number  subtracted  from  the  larger  number. 

An  exception  occurs  with  a  COMPARE  box.  Such  a  box  has  two  input 
links.  A  match  exists  if  the  number  of  digits  for  the  two  links  are 
equal.  Place  the  value  of  the  absolute  difference  in  the  row  of  the  link 
with  the  higher  value. 

A  COMPUTATION  box  produces  no  mismatch  with  the  input  link. 


Example  Consider  the  transfer  chart  and  table  for 
a  hypothetical  task  and  system  as  shown  in  the  foldout 
at  the  back  of  this  manual.  Labels  for  the  indicators 
and  controls  have  been  omitted  from  the  figure.  The 
task  consists  of  the  six  information  transfers  listed 
below  in  terms  of  links  and  boxes: 

1,  Bi,  2 

3.  4,  B2,  5 

6,  8,  7 

9 

10,  11,  12 

13,  B3,  14,  15  (assuming  C^  and  Cg 
are  both  set  almost 
simultaneously) 
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Assume  that  the  first  three  columns  of  the  transfer  chart  (Table  Al, 
on  foldout)  have  already  been  filled  in.  Subsequent  results  in  column  4 
are  shown  underlined.  The  match  calculation  coresponding  to  each 
link  number  will  now  be  explained,  using  hypothetical  data. 

Link  1  Ij  has  100  divisions  (i  =  2),  of  which  only  50  are 
read  out  or  distinguished  (i  =  1.7)  and  used  in  computation 
(one  at  a  time).  Therefore,  the  mismatch,  M^,  is  2  -  1.  7  = 

.  3  and  |mJ  =  .  3. 

Link  2  Due  to  the  nature  of  the  computation,  50  different 
input  values  give  only  20  different  results  (i  =  1.  3).  a 

continuous  dial,  has  100  divisions  (i  =  2):  =  2  -  1.  3  =  .  7. 

Link  4  Information  from  Ij^  (i  =  2)  and  from  (i  =  3)  is  com¬ 
pared.  Their  difference  is  a  mismatch  and  is  written  opposite 
the  link  with  highest  i  value;  [M^  =3-2  =  1. 

Link  5  The  comparison  is  two  way  (  =  ,  /)  which  gives  i  =  .  3. 

C2  has  5  positions  (i  =  .7);  =  .  7  -  .  3  =  .4. 

Link  7  Information  fromI„  (i  =  3)  and  C„  (i  =  .  9)  is  combined 
to  operate  C^-.  ig  +  ig  =  3  +  .  9  =  3.  9.  has  .  7  digits;  jM,J  = 

3.  9  -  .  7  =  3.  2. 

Link  9  Link  9  is  a  direct  link;  jMg]  =  1. 48  -  .  9  =  .  58. 
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Link  12  is  operated  on  the  basis  of  information  from 

either  I„  or  I..  The  maximum  of  1.  48  or  2.  3  is  taken  as 
3  4 

the  information  for  link  12.  The  mismatch  for  link  12  is 
then  2.3-2  =  .  30. 

Link  13  Ig  has  50  different  possible  readings  (i  =  1.7), 
while  the  table  has  1000  input  values  listed  (i  =  3);  = 

3  -  1.7  =  1.3. 

Link  14  There  are  500  different  output  values  from  the 
table  (i  =  2.  7).  has  2  digits:  =  2.  7  -  2  =  .  7. 

Link  15  has  200  states  (i  =  2.3):  Im 

■  a  I 

=  .  4.  The  preceding  example  was  designed  to  illustrate 
a  variety  of  mismatch  situations  and  is  not  typical  of  actual 
systems. 

Link  Weights 

In  addition  to  the  match  calculation,  weights  are  assigned  to  each  link 
and  to  the  boxes. 

16.  Link  weights  are  obtained  by  consulting  the  "Display  Digits"  or  "Action 
Digits"  columns,  the  transfer  chart,  and  Table  2. 


J  =2.7  -2.3 
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Table  2 


Link  Weights 


Type  of  Link  Digits  (i)  Weight  (w) 


Corroborative  less  than  .5  0.  5 

Corroborative  .  5  or  more  1 .  0 

To[^  or  from  any  0.  0 

Instruction  or  information  less  than  .5  1.0 

Instruction  or  information  .  5  or  more  2. 0 

From  box  1 .  0 


A  box  is  given  a  "link"  weight  of  4.  The  weight  of  an  instruction  link 


is  based  on  the  information  for  the  control,  while  the  weight  of  an  in¬ 
formation  link  is  based  on  the  information  from  the  indicator.  Using 
the  transfer  chart,  column  2  of  the  transfer  table,  and  filling  in  the 
weights  gives  the  results  in  column  5  of  the  foldout  transfer  table 
(Table  Al). 


Time  Limits 

17,  If  a  time  limit  has  been  set  or  is  inherent  in  part  of  a  task  (subtask) 
then  the  Time  t  column  must  be  completed  only  for  the  final  links 
going  to  an  indicator  or  control  and  for  boxes  which  are  involved  in 
the  time  limited  subtasks. 


For  an  information  link  to  an  indicator  or  control, 
calculate  Time  t  (in  seconds)  employing  the  formula: 


t  =  .  5i  +  . 15 


where  i  is  the  number  of  Display  Digits  associated  with 
the  link. 
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For  a  transfer  involving  a  box,  add  the  operation  time 
for  the  box  to  the  link  times. 

The  transfer  table  is  now  complete  and  will  be  used  later  to  derive  some 
of  the  data  for  the  DEI. 

DEI  Computation 

Further  steps  in  the  computation  are  now  delineated  continuing  with  the 
previous  numbering. 

18.  Sum  all  the  numbers  in  column  5  of  the  transfer  table.  This  gives  Zw. 
Add  1  to  this  and  place  this  number  on  line  1  of  the  worksheet  labeled 

1  +  2w.  A  sample  worksheet  is  included  in  the  appendix  of  this  manual. 

19.  Count  those  indicators  and  controls  on  the  transfer  chart  which  are  con¬ 

nected  to  either  an  information  or  instruction  link  (solid  line).  This 
gives  the  number  of  "used"  elements  (n  +  example,  in  Fig¬ 

ure  7,  there  are  3  used  elements.  Place  this  number  on  line  2,  labeled 

(n  +  m)  ,  on  the  worksheet. 

_ u 

20.  Count  all  indicators  and  controls  on  the  transfer  chart.  This  gives 
(n  +  m)^.  Place  this  number  on  line  3  labeled  (n  +  m)^. 

21.  Count  the  instruction  and  information  links  (solid  lines)  on  the  trans¬ 
fer  chart.  This  gives  N  which  is  recorded  on  line  4  of  the  worksheet. 
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22.  Find  the  total  number  of  parts,  Q,  on  the  transfer  chart.  To  do  this, 
add  all  the  (D)  subscript  numbers,  counting  indicators  and  controls 
without  this  label  as  (Dl).  See  step  10,  Record  Q  on  line  5  of  the 
worksheet. 


23.  Count  the  elements  on  the  transfer  chart  other  than  indicators  and 
controls,  i.e.,  the  mixers  (^),  gates  (f^),  and  boxes.  This  gives 
nQ.  Record  on  line  6  of  the  worksheet. 


24.  If  any  indicator  or  control  consists  of  pushbuttons  or  ON-OFF  lamps 
or  devices  and  if  the  number  of  states,  indications,  etc.  ,  is  12  or 
more  (i  =  1.  08  or  more)  then  the  factor  ^  is  applicable  to  this  in¬ 
dicator  or  control.  R  is  the  smaller  of  — ,  The  value  of  q  is  the 

q'  r 

number  of  parts- -the  same  number  as  is  used  to  calculate  Q.  The 
calculation  of  the  £  is  illustrated  in  the  following  examples; 


Example  1  A  function  is  controlled  by  247  pushbuttons 
(q  =  247).  The  presence  of  each,  except  the  leftmost 
digit  of  the  number  247  contributes  10  to  r.  Thus,  the 
units  and  the  tens  position  each  contribute  10,  or  a  total 
of  20.  The  specific  digit  in  these  positions  is  not  rele¬ 
vant.  The  leftmost  digit  is  important.  It  contributes 
one  more  than  its  value.  In  this  example,  it  contributes 
2  +  1=3.  r  is  the  total  of  these  contributions  or  20  +  3 
=  23.  R  is  the  smaller  of  ^ 

if  the  leftmost  digit  is  from  2  to  9,  and  all  digits  to  its 
right  are  zero,  it  contributes  itself.  If  the  leftmost  digit 
is  1  and  all  digits  to  its  right  are  zero,  it  contributes 
nothing.  For  s  =  100,  r  =  20;  for  s  =  300,  r  =  23. 
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Example  2  An  indicator  consists  of  4  lights  which  are 
used  in  combination  to  give  15  different  signals  (i  =  1.  18). 
There  is  one  position  on  the  right  which  contributes  10  to 
r.  The  leftmost  digit  is  1:  its  contribution  is  1  +  1  =  2. 
Accordingly,  r  =  10  +  2  =  12  and 


r  _  12  £  _  D  =  _1  -  ^ 

q“4'r"l2'  12  "S 


Multiply  all  R  factors  together.  This  gives  R.  If  one 
^  factor  exists.  the^R  =  R.  If  no  R  factors  exist,  then 
R  =  1.  Record  this  R  value  on  line  10  of  the  worksheet. 


25. 


If  several  time  critical  subtasks  exist,  treat  each  subtask  as  follows. 
Consider  the  first  time  critical  subtask.  Sum  the  t  values  (column  6  of 
the  transfer  table)  which  are  associated  with  subtask  1.  Be  sure  to  in¬ 


clude  the  time  used  in  operations  represented  by  boxes.  This  gives  T^. 
Add  the  i  values  associated  with  each  of  the  t  values.  This  gives  L  . 

Tf  g  ^ 

Calculate  the  value  of  I,(;^)  where  T'  is  the  allotted  time  for  task  1. 

Ti  1  3  Tj  T^  T^ 

To  do  this,  calculate  —  and  either  look  up  (7^)  or  calculate  (=7) (7^) (7=7-). 

1  1  S  S  S 

Then  multiply  this  cube  by  1^. 

If  the  allotted  time  T'  is  less  than  the  required  time  T.,  calculate 
■^1 

1). 


Make  these  computations  for  all  time  critical  subtasks  and  sum  the 
T  3  T  3 

I(— ,)  values.  This  gives  ZI(— )  •  Record  on  line  12  of  the  record 

T  T 

sheet.  Also  sum  the  1(7^7,  -  1)  values.  This  gives  £I  ,  -  1).  Record 
on  line  14  of  the  record  sheet. 
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Example  For  the  system  shown  on  the  foldout,  assume 
that  subtask  1  consists  of  operating  C3  and  C4  based  on 
the  information  transfers  9,  10,  11,  12.  The  time,  Ti, 
allotted  for  performance  is  2.  5  seconds.  A  second  sub¬ 
task  consists  of  only  one  information  transfer  (6,  8,  7) 
and  has  an  allotted  time,  of  2.  0  seconds. 

Consider  the  first  subtask  (transfers  9,  10,  11,  and  12). 
The  value  of  t  for  link  9  is: 

t  =  .  5i  +  .  15  =  .  5(1.  48)  +  .  15  =  .  74  +  .  15  =  .  89  seconds. 
For  link  12, 

t,„  =  .5(2.3)  +  .  15  =  1.  15  +  .  15  =  1.  30  seconds 
The  total  time,  Tj,  for  task  1  is: 

.  89  +  1.  30  =  2.  19  seconds 

For  subtask  1,  the  allotted  time,  T^,  was  2.  5  seconds. 
The  required  time  for  subtask  1  does  not  exceed  the 
allotted  time;  accordingly,  only  Ii(Tj/Tp^  is  calculated. 
The  information  associated  with  transfer  10,  11,  12  is 
that  for  link  12,  viz.  ,  2.  3  digits.  For  link  9,  ig  =  1.  48. 

The  total  information  for  subtask  1  is  Ij  =  2.  30  +  1.  48  = 
3.  78  digits.  Therefore; 

T 

IS  1  qq  S  S 

I,(=r)  =  3.78(-=:~)  =  3.78(.796)  =  3.  78(.  504)  =  1.91 

1  Tj  2.5 

The  calculation  for  subtask  2  (transfers  6,  8,  7)  is  as 
follows: 

The  value  of  t  for  link  7  is  obtained  by  computing  t  for 
3.  9  digits: 

t  =  .  5(3.  9)  +  .  15  =  1 . 95  +  .  15  =  2.  10  seconds 

The  total  time,  To,  is  2,  10  seconds.  This  exceeds 
the  allotted  time  of  2  seconds  so  that  both  l2(— ^)^  and 
l2(^~  -  1)  must  be  computed.  Therefore:  '^2 

'^2 
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3.  9(1.  16)  =  4.52 


I 

II 


11 

11 


=  3.9(^^)^  =  3.9(1.05)^  = 

2 

'^2 

and  -  1)  =  3.  9(1.  05  -  1)  =  3.  9(.  05)  =  .  195 


Now  the  totals  for  both  subtasks  are  calculated; 


21  (J,)^  =  1.  91  +  4.  52  =  6.43 


and  £l(i  -  1)  =  .  195 


26.  Sum  the  values  in  column  4  of  the  Transfer  Table.  This  gives  the 
sum  of  the  absolute  mismatches,  2|m|  .  Record  this  sum  on  line  15 
of  the  worksheet. 


27.  On  the  transfer  table,  check  those  links  associated  with  critical  trans¬ 
fers.  A  critical  transfer  is  one  which,  if  not  accomplished  properly, 
causes  the  whole  task  to  fail.  Count  the  number  of  checks.  This  gives 

N  .  Record  on  line  16  of  the  worksheet.  All  variables  have  now  been 
c 

calculated  and  recorded;  all  that  remains  is  the  calculation  of  the  DEI 
value. 

Final  Calculation 

Further  calculations  are  carried  out  on  the  basis  of  the  data  already 
on  the  worksheet. 


i 

1 
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28.  Total  the  values  on  lines  5  and  6  of  the  worksheet.  This  gives  (Q  +  n^). 


29.  Calculate  the  product  of  lines  4,  3,  and  7;  write  the  product  on  line  8. 

30.  Look  up  or  calculate  the  square  root  of  line  8  and  write  result  on  line  9. 

31.  Calculate  the  fourth  root  of  R  (line  10).  One  method  is  to  take  the 
square  root  of  the  square  root  of  R,  i.  e.  , 

VW  =  V<^ 

32.  Calculate  of  line  12;  write  the  result  on  line  13. 

lo 

33.  Write  of  line  16  on  line  17. 

34.  Total  lines  13,  14,  15,  and  17  and  write  the  result  on  line  18. 

35.  Calculate  t  of  line  18  and  write  the  result  on  line  19. 

4 


36.  Look  up  the  exponential  function  value  of  the  negative  of  line  19. 

Example  Suppose  sum  =  .  42 

Then  a  table  of  exponential  functions  gives 


37.  Calculate  the  final  DEI  (without  cost  factor)  by  multiplying  the  values 
of  lines  2,  11,  and  20  and  dividing  this  by  the  product  of  lines  1  and  9. 
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Uniformity  of  Application 


If  at  all  possible,  analyses  of  variations  of  the  same  design  should  be 
uniform  or  consistent.  It  is  better  to  make  the  same  assumptions  or  judge¬ 
ments  in  all  evaluations  than  to  make  random  assumptions  or  independent 
judgements.  Therefore,  one  analysis  should  be  used  as  the  basis  for  incre¬ 
mental  changes  in  the  number  of  elements,  links,  mismatch,  etc.  ,  for  all  other 
variations. 

The  0  to  1  Scale 

In  certain  cases  it  may  be  desirable  to  convert  the  obtained  DEI  values 
to  a  scale  which  ranges  from  0  to  1,  where  the  equipment  variation  with  the 
lowest  DEI  value  is  given  a  rating  of  0  and  the  variation  with  the  highest  DEI 
a  rating  of  1. 

Each  variation  will  have  a  rating  calculated  as  follows; 

(1)  Compute  I  ■  lowest  DEI  value, 

and  I  is  any  variation. 

(2)  Divide  I  -  L  by  I  -  L  where  I^  is  the  greatest 

DEI  value.  ^  G  1^  G 

This  procedure  gives  the  relative  0  to  1  value  for  variation  i. 

As  an  example,  suppose  the  results  shown  below  are  the  DEI  values  for 
five  different  equipment  variations. 
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DEI(I) 


4 


Variation 


o 

.0132 

.  0022 

.  10 

1 

.0251 

.  0141 

.  65 

2 

.  0110 

0 

0 

3 

.0328 

.  0218 

1 

4 

.0187 

.  0077 

.35 

The  results  may  then  be  plotted  directly  on  a  10  cm.  scale  as  shown 


below: 


2  0  4 


LOWEST 


1  3 


HIGHEST 


Hints  for  the  Construction  of  Transfer  Charts 

The  following  examples  are  intended  to  be  helpful  in  constructing  the 
transfer  chart  and  table.  The  operation  is  stated  first.  This  is  followed  by 
the  section  of  the  transfer  chart  corresponding  to  it.  An  explanation  and  com 
ments  are  then  given. 


Example  1  Procedural  instructions  require  a  con¬ 
trol  to  be  set  to  a  fixed  predetermined  position. 

- ^ 

An  instruction  link  is  employed.  The  weight  of  this 
link  is  determined  by  the  number  of  states  of  the  con¬ 
trol.  Assume  the  control  to  be  a  POWER  ON-OFF 
switch  (two  states):  logj^O^  ~  which  is  less  than 
.  5;  w  =  1.  No  mismatch  is  attributed  to  an  instruction 
link. 
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Example  2  Set  according  to  a  fixed  tabularized 
input. 


1 


Table  : 
Lookup 


2 


C 


1 


Link  1  is  an  instruction  link  and  as  such  can  contain 
no  mismatch.  Link  2  is  an  information  link.  The 
match  depends  on  the  difference  between  the  number 
of  different  table  entries  and  the  number  of  states  of 
the  control. 


Example  3  According  to  fixed  instructions,  operate 
a  self-indicating  pushbutton. 


This  is  an  instruction  link  and  as  such  possesses  no 
mismatch. 


Example  4  According  to  fixed  instructions,  throw 
switch  Cl  to  ON.  When  in  the  ON  position,  indicator 
lights. 

h  . - . 


Link  1  is  an  instruction  link. 

Link  2  is  a  corroborative  link. 

Wi  =  1,  Wg  =  -j-  Since  Ci  and  Ii  both  possess 
two  states,  no  mismatch  can 
exist. 
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Example  5  A  verbal  command  is  given  to  set  a  switch 
to  one  out  of  a  number  (N)  of  possible  positions. 


(f~\ - i - ^ 

If  n  >3,  Wj  =  2 
If  n  <  3,  Wj  =1 

Example  6  Set  Ij^  to  a  predetermined  value  by  means 
of  Cl- 

- - Cj 


Q 


COMPARE 


The  present  setting  of  Ij^  is  compared  with  the  desired 
or  nominal  value.  Link  2  is  an  instruction  link.  No 
mismatch  can  occur  for  links  1  or  2;  wj  =  W2;  Wj  depends 
on  ij.  If  Cl  is  continuous  and  uncalibrated,  no  mismatch 
occurs  for  link  3.  A  link  from  a  box  has  a  weight  of  1; 

W3  =  1. 


Example  7  Mark  the  position  or  state  of  an  indicator  on 
the  indicator.  Mark  the  position  or  state  of  a  control  on 
the  control. 

■  Ct)  qA  c 

The  link  weight  depends  on  the  number  of  states  of  the  in¬ 
dicator  or  control,  respectively. 


c 


Example  8  Cj  is  to  be  set  according  to  Ij.  Ij  has 
5  independent  but  related  lights  and  has  8  independ¬ 
ent  but  related  pushbuttons. 

(D5)  (D8) 


I 


1 


The  (D5)  indicates  the  5  parts  of  Ij  and  the  (D8)  the  8 
parts  of  the  Cj.  The  Q  value  is  5  +  8  =  13. 


Example  9  Set  to  the  reading  of  I2  by  means  of  Cj. 


Assume  to  possess  20  states,  I2  to  possess  50  states, 
and  to  be  continuous.  There  is  an  information  mis¬ 
match:  logio^O  ■  logjo^®  ■  ^  =  .4  digits.  This 

is  attributed  to  the  link  from  the  indicator  having  the 
greatest  information- -link  2.  The  output  from  the  com¬ 
pare  box  has  3  states  in  this  case  (greater  than,  equal 
to,  and  less  than).  Since  Cj  may  be  moved  in  either 
direction  or  left  unchanged,  there  is  then  no  mismatch 
for  link  3.  Weights  are  assigned  to  links  1  and  2  accord¬ 
ing  to  the  number  of  digits  associated  with  and  I2;  W| 
and  W2  have  values  of  2.  The  link  (3)  from  the  box  has  a 
fixed  weight  of  1. 


Example  10  Extremize  (maximize  or  minimize)  an  in¬ 
dicator  reading  by  means  of  a  control  knob, 

o - A 

The  operation  of  extremizing  is  not  of  such  complexity 
as  to  warrant  the  use  of  a  box.  Any  divisions  on  the  in¬ 
dicator  and  control  are  ignored  (only  3  states  are  assumed 
to  exist),  so  that  normally  no  mismatch  exists. 
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Example  11  Set  control  Cj  according  to  informa¬ 
tion  on  a  general  purpose  meter,  I^,  whose  function 
has  been  selected  by  selector  switch  C2. 


Link  2  is  an  enabling  link  (a  special  type  of  informa¬ 
tion  link  which  allows  information  transfer  to  take 
place).  Any  mismatch  would  be  between  the  informa¬ 
tion  associated  with  1^  and  C^.  The  weights  of  links 
1  and  2  depend  on  the  number  of  states  of  and  C2; 
the  weight  of  the  link  from  the  gate  (W3)  is  0. 
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Cost  Factor 

The  DEI  value  already  calculated  is  multiplied  by  the  cost  factor  when 

the  cost  of  the  equipment  is  to  be  taken  into  consideration. 

Divide  the  actual  cost.  by  $  .  the  reasonable  cost,  and  subtract  the 

1  r 

quotient  from  1.  This  gives; 

r 

The  result  may  be  positive  or  negative.  Look  up  the  value  of  the  exponential 
function  for  this  value  of  1  -  -j—  .  This  gives: 

exp(l  -  -ji-) 

’r 

Divide  the  operating  cost  per  year,  by  the  reasonable  cost, 
and  add  1  to  the  quotient.  This  gives: 

l.fo 

»r 

Divide  this  into  the  previously  calculated  exponential  function  value; 


E  = 


expd  -  -ji-) 


Raise  E  to  the  appropriate  power  f.  In  the  absence  of  any  predetermined  value, 
it  is  suggested  that  f  =  y  be  used.  This  is  equivalent  to  taking  the  cube  root  of  E. 
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Example  Assume  the  reasonable  cost  (1^,)  of  an 
equipment  to  be  $10,  000,  the  actual  cost  ($j^)  to  be 
$11, 000,  and  the  operating  cost  per  year  ($o)  to  be 
$1,000. 


^  ^  11,000  _  1  1 

$  10,000 

r 


1  -  =  1  -  1.  1  =  -.  1 

$ 

r 


exp(-.  1)  =  .  905 


^0  1.000 

$  10,000 

r 


1 


=  1  +  .  1  = 


exp(l  - 


1.  1 


905 

1.  1 


.823 


The  cost  factor  is 


3y —  1 

vE  if  f  is  taken  to  be  ^ 


Vl23 


.  937 


If  the  DEI  value  previously  calculated  is  .  00230,  then 
the  resulting  value  is  .  00230  x  .  937  =  .  00215. 
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Symbols  Used 


DEI 

E 


exp(x)  =  e* 
i 

I 

I' 

m 

M 

n 

"o 

N 

N 

c 

(n  +  m)^ 

(n  +  m)^ 

q 

Q 

r 

R 

R 


display  evaluative  index 
base  for  expense  factor 
expense  factor 
exponential  function  of  x 

information  in  digits  associated  with  an  indicator  or  control, 
also  information  associated  with  one  transfer 

total  information  transfer  for  one  subtask 

DEI  value 

number  of  controls 

match  in  digits  for  an  information  transfer 
number  of  indicators 

number  of  elements  other  than  indicators  or  controls  on  transfer 
chart 

total  number  of  information  and  instruction  links 
number  of  critical  links 

total  number  of  elements  (used  and  unused) 
number  of  "used  elements" 

actual  number  of  ON-OFF  parts  of  an  indicator  or  control 

total  number  of  indicator  and  control  parts 

required  (ideal)  number  of  parts  for  a  multiple  part  element 

utilization  efficiency  factor  for  one  element 

product  of  all  utilization  efficiency  factors 
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number  of  states  associated  with  an  element 


actual  initial  cost  of  equipment 
operating  cost  of  equipment /year 
reasonable  cost  of  equipment 
summation  sign 

time  in  seconds  actually  required  to  make  an  information  transfer 
total  actual  time  required  for  one  subtask 
allotted  time  for  one  subtask 


weight  of  a  link 


GLOSSARY 


Box 


Control 


Corroborative  link 


Critical  transfer 


Digit 


Enabling  link 


Gate 


a  symbol  (|  |)  which  is  inserted  in  a  link  when  consider¬ 

able  data  processing  by  the  operator  is  involved  in  an 
information  transfer;  the  box  is  used  to  indicate  functions 
such  as  computations,  comparisons,  code  conversion, 
delay  (retention  in  memory)  and  information  distribution. 

an  element  wliich  is  responsive  to  some  physical  action 
by  the  operator  and  which  affects  the  state  of  the  system. 

A  control  may  consist  of  a  number  of  related  dependent 
parts.  A  control  is  considered  as  one  unit  on  the  transfer 
chart  and  in  calculating  (n  +  m)^  and  (n  +  m)^.  If  a  con¬ 
trol  consists  of  separate  ON-OFF  type  parts,  each  part 
is  counted  separately  for  the  Q  calculation.  The  control 
symbol  on  the  transfer  chart  is  then  also  labeled  with  a 
(Dn)  symbol  where  n  is  the  number  of  parts. 

a  dashed  line  drawn  from  a  control  to  an  unused  indicator 
when  that  indicator  reflects  the  setting  of  the  control,  and 
that  control  is  operated  in  the  course  of  performing  the 
task. 

an  information  transfer  which:  (1)  must  be  performed, 

(2)  if  performed  improperly  is  not  correctable  or  repeat- 
able,  and  (3)  if  performed  improperly  will  cause  failure 
of  the  whole  task. 

a  unit  of  information  equivalent  to  that  of  a  ten  state  device. 
The  amount  of  information  in  digits  is  given  by  the  formula 

i  =  log^pn 

where  n  is  the  number  of  states  of  an  element.  One  digit 
is  equivalent  to  3,  32  bits. 

an  information  link  to  a  gate  ([^)  which  allows  the  trans¬ 
fer  of  information  by  other  links  (through  the  same  gate) 
to  a  control. 

a  symbol  ([^>)  used  on  the  transfer  chart  when  information 
from  two  or  more  sources  is  required  in  order  to  actuate 
a  control. 
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Indicator 


Information 


Information  link 


Information  transfer 


Inhibiting  link 


Instruction  link 


Match  (mismatch)M 


Mixer 


an  element  capable  of  assuming  a  variety  of  states  which 
are  distinguishable  by  the  operator.  An  indicator  may 
consist  of  a  number  of  related,  dependent  parts.  An  in¬ 
dicator  is  considered  as  one  unit  on  the  transfer  chart 
and  in  calculating  (n  +  m)u  and  (n  +  m)^.  If  an  indicator 
consists  of  separate  ON-OFF  type  parts,  each  part  is 
counted  separately  for  the  Q  calculation.  The  indicator 
symbol  on  the  transfer  chart  is  then  labeled  with  a  (Dn) 
symbol  where  n  is  the  number  of  parts. 

a  measure  of  the  number  of  different  possible  states  of 
an  indicator  or  a  control,  given  by  the  formula 

i  =  log^^n 

where  n  is  the  number  of  different  states.  The  unit  of 
information  is  the  digit. 

a  line  drawn  on  a  transfer  chart  from  an  element  used  as 
an  indicator  or  from  any  |  |  or  symbol  when  a  transfer 

of  information  is  involved. 

information  transfer  occurs  when  the  operator  perceives 
and  distinguishes  one  out  of  two  or  more  possible  states 
of  a  display  element  and  takes  some  action  based  on  this 
display.  On  the  transfer  chart  it  is  represented  by  all 
the  links  and  connecting  symbols  leading  to  the  element 
acted  on. 

an  information  link  to  a  gate  ([?>)  which  prevents  the  trans¬ 
fer  of  information  by  other  links  (through  the  same  gate) 
to  a  control. 

a  line  drawn  on  a  transfer  chart  to  a  control  when  that 
control  is  set  to  a  fixed,  predetermined  position  accord¬ 
ing  to  operating  instructions.  Only  one  instruction  link 
may  be  drawn  to  any  one  control. 

the  difference  in  the  amount  of  information  associated 
with  two  different  elements,  e.  g.  ,  an  indicator  and  the 
control  with  which  it  is  linked. 

a  symbol  ([^)  used  on  the  transfer  chart  when  any  one  or 
more  than  one  source  of  information  may  be  used  as  the 
basis  for  a  control  action. 
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Reasonable  cost  ($  ) 
r 

Subtask 

Task 

Unused  element 

Used  element 


cost  as  estimated  by  the  customer  or  as  is  known  from 
experience  with  similar  equipment. 

a  set  of  operations,  usually  a  fractional  part  of  the  task. 
A  subtask  may  in  some  cases  correspond  to  one  link  or 
it  may  be  the  whole  task. 

the  utilization  of  an  equipment  to  accomplish  a  specified 
operational  end  result  or  results. 

an  element  (indicator  or  control)  which  is  not  connected 
to  an  instruction  nor  to  an  information  link. 

an  element  (indicator  or  control)  which  is  connected  to 
an  instruction  or  information  link. 
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APPENDIX  A 


Appendix  A  presents  the  following: 

1.  Sample  worksheet  for  the  DEI  calculation 

2.  Transfer  chart  (Figure  Al)  referred  to  in 
previous  section  of  this  report 

3.  Transfer  table  (Table  Al)  referred  to  in 
previous  section  of  this  report 
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DEI  WORKSHEET 


Date 


_ Name  of  Analyst 

Equipment 

DEI  Value 


1. 

(1  +  Zw) 

=  ! 

2. 

(n  +  m) 

=  1 

3. 

u 

(n  +  m)^ 

4. 

N 

5. 

Q 

= 

6. 

■^0 

= 

7. 

(Q  +  oq) 

"  (5.)  + (6.) 

8. 

N(n  +  m)t(Q  +  no) 

(4.)(3.)(7.) 

9. 

\/N(n  +  m)^(Q  +  Uq) 

'=  vtO 

10. 

R 

= 

11. 

12. 

1  .T  ,3 

16 

- 

13. 

= 

14. 

T 

ri  ^  -  1) 

= 

15. 

2:\m\ 

= 

16. 

N 

- 

c 

17. 

N 

10  c 

- 

18. 

Sum 

=  (12. )+(14. )+(15. : 
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Figure  Ai 


Trantfer  chart. 


Table  Ai 


Transfer  table. 
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